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ANOMALOUS  BEHAVIOR  OF  THE  FIFTY-PERCENT  RULE 
1.0  INTRODUCTION 

Dynamic  storage  allocation  strategies  address  the  problem  of  choosing, 
from  among  a set  of  available  blocks  of  storage,  one  in  which  to  allocate  a 
given  storage  request.  If  storage  requests  are  rounded  up  to  the  nearest  multiple 
of  some  allocation  unit,  then  the  storage  wasted  by  this  procedure  is  referred 
to  as  internal  fragmentation  [1].  Whether  storage  requests  are  rounded  up  or  not, 
some  available  storage  is  usually  wasted  because  of  the  proliferation  of  blocks 
of  available  storage  that  are  too  small  to  satisfy  a pending  request.  This  phe- 
nomenon is  referred  to  as  external  fragmentation  [2].  In  general,  the  choice  of 
allocation  strategy  will  affect  a variety  of  dynamic  performance  measures,  such  as 
the  amount  of  fragmentation  or  the  efficiency  of  using  the  total  amount  of  storage. 

It  would  be  nice  if  one  could  study  the  relative  merits  of  different  allo- 
cation strategies  by  means  of  mathematical  analysis,  and  thereby  reach  more 
general  conclusions  than  those  that  tend  to  result  from  such  empirical  studies 
as  [1-9].  Mathematical  analysis  is  generally  feasible  in  the  case  of  internal 
fragmentation,  because  internal  fragmentation  depends  only  on  the  probability 
distribution  of  request  sizes  and  on  the  round-up  rules.  In  most  cases,  neither 
the  request  distribution  nor  the  round-up  rules  depend  on  the  current  memory  state, 
so  that  one  can  compute  the  expected  internal  fragmentation  without  reference  to 
the  dynamics  of  storage  allocation  and  release.  Examples  are  [10,11]. 

Although  some  results  have  been  obtained  [12,13],  external  fragmentation 
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that,  in  attempting  to  write  a mathematical  definition  of  a given  allocation 
strategy,  one  obtains  a rather  perverse  function  of  the  current  memory  state  in  a 
form  that  defies  the  closed-form  computation  of  expected  values  for  various  dynamic 
functions  of  the  memory  sta_e.  A less  ambitious  approach  is  to  attempt  analysis 
that  is  valid  for  large  classes  of  allocation  strategies,  a procedure  that  can 
obviate  dealing  with  functions  dependent  on  the  memory  state.  The  "fifty-percent 
rule"  is  a well  known  result  of  such  an  analysis.  First  derived  by  Knuth  [3], 
the  fifty-percent  rule  gives  an  estimate  for  the  quantity  p defined  by 

p - equilibrium  ratio  of  the  average  number  of  free 

blocks  of  storage  to  the  average  number  of  allocated  blocks. 

An  allocated  block  is  a contiguous  sequence  of  memory  words  in  which  is  allocated 
a single  storage  request.  A free  block  is  a contiguous  sequence  of  unallocated 
words  delimited  on  both  ends  by  allocated  blocks  or  by  one  end  of  the  memory. 

Knuth's  analysis  resulted  in  an  approximate  estimate  p*  of  p given  by 


where 

Pf  = probability  that  any  given  allocation  will  not  exactly 

fill  the  selected  free  block  (i.e.,  the  probability  that 
a fragment  remains). 

In  situations  where  request  sizes  are  infrequently  equal,  the  probabiliy  p^.  will 
be  close  to  1 and  the  ratio  p therefore  close  to  y.  Other  derivations  have 
ignored  the  possibility  of  exactly-fitting  allocations,  with  the  result  that  the 
estimate  p » j is  obtained  directly  ,r14]. 

In  analyzing  the  simulation  data  reported  in  [7],  I was  surprised 
to  find  that  the  ratio  p was  significantly  less  than  the  estimate  given  by  Eq.(l.l). 
These  observations  led  to  additional  studies  that  are  the  subject  of  the  present 
paper. 
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The  next  section  describes  the  simulation  that  produced  the  anomalous 


observations,  the  observations  themselves,  and  how  the  anomaly  could  be  made  to 


disappear  by  modifying  the  manner  in  which  requests  are  placed  in  the  free  block 


selected  by  the  allocation  strategy.  Section  3 contains  derivations  that  illuminate 
the  anomalous  behavior.  It  is  shown  that  previous  derivations  [3 , 14 ] contain  an 


implicit  assumption  that  may  be  violated  frequently.  Section  4 contains  the 


results  of  new  simulations  that  support  the  conclusions  reached  from  the  derivations 


in  Section  3.  General  conclusions  are  discussed  in  Section  5 


2.0  THE  ANOMALOUS  BEHAVIOR 


Simulation  Description 


The  following  description  of  the  simulation  is  taken  from  [7],  where 


additional  details  can  be  found 


The  simulator  attempts  to  allocate  an  infinite  proffered  workload  of 


storage  requests  in  a fixed-size  memory.  Storage  is  allocated  in  units  of  one 


word  so  that  no  more  than  the  requested  amount  is  ever  allocated.  Resulting 


fragmentation  is  therefore  purely  external.  The  event-driven  simulator  maintains 


a list  of  available-storage  blocks.  When  an  allocated  block  is  released,  the 


simulator  determines  whether  it  is  located  adjacent  to  one  or  two  blocks  already 


on  the  available-storage  list.  If  so,  the  appropriate  blocks  are  combined  by 


suitable  modifying  the  available- storage  list.  If  not,  the  newly  released  block 


is  added  to  the  list.  The  simulator  then  attempts  to  allocate  the  pending 


storage  request.  If  there  is  space  for  it,  the  request  is  allocated  as  the  low 


address  end  of  whichever  available  block  is  selected  by  a prespecified  alloca 


tion  strategy.  The  available-storage  list  is  modified,  and  the  newly-allocated 


space  is  scheduled  for  release  at  a time  randomly  selected  from  a prespecified 
distribution.  Following  a successful  allocation,  the  simulator  continues 


to  generate  and  allocate  new  requests  until  an  attempted  allocation  fails. 

Whenever  failure  occurs,  the  simulator  computes  various  quantities  of  interest, 
such  as  the  number  of  free  blocks,  their  average  size,  etc.,  and  updates  summary 
statistics.  The  simulator  then  advances  to  the  next-scheduled  storage  release 
and  continues  as  described  in  the  foregoing  until  a prespecified  time  limit  is 
reached.  Summary  statistics  are  then  stored  and  the  simulator  begins  anew  after 
clearing  memory  and  reinitializing  everything  but  the  random  number  generator. 
During  one  run,  the  simulation  is  repeated  for  a prespecified  number  of  such 
iterations,  N,  after  which  the  statistics  for  each  iteration  and  averages  over 
the  ensemble  of  iterations  are  printed. 

Among  the  data  available  after  each  run  are  the  average  number  of  allocated 
and  free  blocks  for  each  of  the  N iterations,  as  well  as  the  variances  of  these 
quantities.  These  data  are  sufficient  to  compute  the  ratio  p for  each  iteration 
and  then  the  average  of  p over  the  ensemble  of  iterations.  This  average  provides 
the  best  estimate  of  p for  the  simulation  conditions.  From  the  variance  in  the 
ratio  for  each  iteration,  and  from  the  variances  in  the  quantities  that  make  up 
these  ratios,  one  can  judge  the  accuracy  of  the  overall  estimate  of  p. 

One  cannot  ignore  the  question  of  whether  or  not  the  averages  computed  by 
the  simulator  correspond  to  time  averages.  In  general,  the  answer  depends  both 
on  the  quantity  being  sampled  and  on  the  sampling  process.  For  an  example  of 
simulation  averages  that  do  not  correspond  to  time  averages,  see  (7].  As  men- 
tioned earlier,  samples  of  the  number  of  allocated  and  free  blocks  are  taken 
after  each  allocation  failure.  Since  allocation  is  attempted  each  time  storage 
is  released,  and  since  allocation  takes  no  time,  samples  are  therefore  taken  at 
the  time  of  every  storage  release.  In  all  of  the  simulations  reported  herein, 
newly  allocated  blocks  were  scheduled  for  release  so  that  their  residence  time 
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was  uniformly  distributed  between  prespecified  limits.  Therefore,  when  the 
average  numbers  of  allocated  and  free  blocks  are  computed  from  sufficiently 
numerous  samples,  each  taken  after  an  allocation  failure,  the  resulting  quantities 
are  valid  estimates  of  time  averages. 

All  of  the  quantitative  results  reported  in  this  paper  are  based  on 
simulations  of  a 32K  word  memory  using  first-fit  allocation  and  exponentially 
distributed  request  sizes.  Results  obtained  using  best-fit  allocation  were  quite 
similar.  The  general  nature  of  the  results  do  not  seem  to  be  sensitive  to  the 
shape  of  the  request  size  distribution,  provided  that  request  sizes  are  infre- 
quently equal  to  each  other.  1 did  not,  however,  perform  systematic  studies 
with  non-exponential  distributions  of  request  sizes. 

2.2  Initial  Simulation  Results 

In  Fig.  1,  the  points  marked  with  circles  (•)  show  the  results  of  a series 
of  experiments  in  which  the  ratio  p was  measured  as  the  mean  request  size  r was 
varied.  The  computation  of  these  points  can  be  clarified  best  by  using  some 
new  notation.  Each  iteration  i of  the  simulation  produces  the  following  numbers: 

E.  (A)  = average  number  of  allocated  blocks 

0^ (A)  variance  of  the  number  of  allocated  blocks 

Ej(F)  = average  number  of  free  blocks 

o.  (F)  variance  of  the  number  of  free  blocks 

l v 

In  all  of  the  experiments  recorded  in  Fig.  1,  the  memory  residence  times 
of  requests  were  uniformly  distributed  between  5.0  and  15.0  time  units.  Typically, 
about  6000  samples  contributed  to  each  (A)  and  (F)  . These  samples  were  taken  after  the 
transients  had  died  down.  The  coefficients  of  variation  o^(A)/Ei(A)  and  o^fFl/E^fF) 
were  generally  less  than  .3,  which  indicates  that  the  averages  E. (A)  and  E. (F) 


RUPP 


are  meaningful  measures.  The  free-to-allocated-block  ratio  for  each  iteration 
was  computed  as  p^  = E^(A)/E^(F).  Each  point  • plotted  in  Fig.  1 is  the 
average  of  p over  ten  iterations  of  the  sample.  Given  the  ten  samples  available 
in  each  case,  these  points  are  the  best  estimates  of  the  mean  of  the  distribu- 
tions of  p^ . The  error  bars  show  the  957  confidence  limits  of  these  estimates. 

Also  plotted  in  Fig.  1 (using  triangles  (A))  are  the  estimates  p predicted 
by  Eq . 1.1.  Values  for  p^.  were  estimated  from  simulation  data  giving,  for  each 
iteration,  the  number  of  exactly-fitting  allocations  and  the  total  number  of 
allocations.  Each  point  is  the  result  of  averaging  data  from  10  iterations. 

The  957  confidence  limits  of  these  mean  estimates  are  about  the  size  of  the 
symbols  A used  to  mark  the  points. 

The  results  in  Fig.  1 show  the  measured  values  of  the  free-to-allocated- 
block  ratio  to  be  significantly  less  than  those  predicted  by  Eq.  1.1.  At  the 
time  when  I first  noticed  the  anomaly,  a colleague  hypothesized  that  it  might  be 
related  to  the  simulation  convention  of  always  allocating  storage  requests  against 
the  same  end  of  the  free  block  selected  by  the  allocation  strategy.  That  is, 
when  the  size  of  a selected  free  block  exceeds  that  of  the  current  storage 
request,  one  has  three  basic  choices  of  where  in  the  selected  free  block  to 

place  the  current  request namely,  at  either  end  of  somewhere  in  between. 

Placing  it  in  between  seemed  foolish  since  that  would  generate  an  extra  fragment. 
Given  that  the  current  request  was  to  be  placed  at  one  end  of  the  selected  block, 
it  seemed  natural  to  select  one  end  (either  the  "low  address"  end  or  the  "high 
address"  end)  and  systematically  allocate  against  that  end  every  time.  This 
convention  of  "systematic  placement,"  as  I shall  call  it,  was  used  in  the  simula- 
tions reported  in  [7]  and  corresponds  to  Knuth's  "Algorithm  A"  [3]. 
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Following  up  on  the  hypothesis  of  my  colleague,  I modified  the  simulation 


so  that  each  request  was  allocated  against  a pseudo-randomly  chosen  end  of  the 


selected  free  block.  The  two  choices  were  made  equiprobable.  I shall  refer  to 


this  alternative  convention  as  "random  placement 


1 marked 


with  the  symbol  X show  the  results  of  repeating  the  measurements  of  p with  random 


placement  instead  of  systematic  placement.  These  results  are  reasonably  close 


to  the  predicted  values  p , which  themselves  were  not  appreciably  affected  by 


the  change  to  random  placement 


In  general,  the  use  of  systematic  placement  resulted  in  both  fewer  free 


blocks  and  more  allocated  blocks  compared  to  random  allocation.  This  better  use 


of  storage  was  reflected  in  the  time-memory  product  efficiency.  If  n requests  of  r 


n,  are  allocated  for  times  t.  in  a memory  of  size  M during  a 


words  i 


total  elapsed  time  T,  then  the  efficiency  E is 


E is  a direct  measure  of  how  well  the  memory  has  been  used.  The  general  question 


of  performance  measures  for  dynamic  allocation  is  discussed  in  [7].  The  efficieu 


cies  obtained  in  the  systematic  and  random  placement  experiments  are  shown  in  Fig.  2 


The  data  for  each  point  in  Fig.  2 were  taken  from  the  same  run  as  the  corresponding 


point  in  Fig.  1 


THE  BEHAVIOR  EXPLAINED 


Derivations 


Some  insight  into  the  results  of  the  previous  section  can  be  gained  by 
considering  Denning's  derivation  of  the  fifty  percent  rule  [14].  His  derivation 
rested  on  the  assumption  that,  during  the  time  an  allocated  block  spends  in 


memory,  half  of  the  transactions  in  the  region  immediately  above  the  block  are 
allocations  and  half  are  releases.  It  is  easy  to  see  that  this  assumption  might 


be  better  satisfied  with  random  placement  than  with  systematic  placement,  since 


systematic  placement  introduces  an  obvious  asymmetry  into  the  allocation  process 


This  is  not,  however,  the  whole  story.  There  is  a less  obvious,  but  equally 


important  asymmetry  in  the  release  process.  This  release  asymmetry  can  be  seen 


with  the  help  of  the  following  derivation,  which  is  motivated  by  that  of  Knuth  [3] 


Allocated  blocks  can  be  classified  according  to  whether  or  not  the  spaces 


immediately  above  them  and  below  them  are  also  allocated.  There  are  three  basic 


a - There  are  free  blocks  on  both  sides.  Release  of  a type  a block 


decreases  by  one  the  number  of  free  blocks 


b - There  is  a free  block  on  one  side.  Release  of  a type  b block  has  no 


effect  on  the  number  of  free  blocks 


c - There  are  allocated  blocks  on  both  sides.  Release  of  a type  c block 


increases  by  one  the  number  of  free  blocks 


We  shall  need  the  following  notation 


average  number  of  allocated  blocks  of  type  a,  type  b 


total  average  number  of  allocated  blocks 


average  total  release  rates  for  type  a block,  type  b 


blocks,  and  type  c blocks,  respectively 


average  release  rates  per  unit  block  for  type  a blocks 


type  b blocks , and  type  £ blocks  , respectively 


v V:i 


number  of  free  blocks 


average  total  rate  of  exactly  fitting  allocations  (each  such 


allocation  decreases  by  one  the  number  of  free  blocks) 


The  average  numbers  of  free  and  allocated  blocks  are  related  by  the  equation 


where  e is  the  average  of  a quantity  e that  is  determined  by  the  boundary  conditions 


as  follows 


0 , if  both  the  first  and  the  last  words  in  memory  are 


if  either  the  first  or  the  last  words  in  memory  are 


allocated,  but  not  both 


i 2 , if  neither  the  first  nor  the  last  words  in  memory  are 


allocated 


By  the  introduction  of  N = N + N,  + N , Eq. (3.1)  can  be  transformed  into 
J a he 


Since  the  average  number  of  free  blocks  is  constant  once  equilibrium  is  reached 
for  each  decrease  in  the  number  of  free  blocks  there  must  be  a corresponding 


increase.  Hence,  the  following  balance  equation  holds 


■ 


A 

e 


+ R 


a 


R 

c 


(3.4) 


Rewriting  Eq.(3.4)as  A + N r = N r , solving  for  N - N , and  substituting 

6 8 3 C C C g 

the  result  into  Eq. (3.3)  yields 


P 


1 . 

/ 


(3.5) 


Thus,  there  are  two  effects  that  can  increase  the  difference  in  the  average 
number  of  type  c_  and  type  a blocks  (Nc  - Nfl).  One  is  determined  by  the  rate 
of  exactly  fitting  allocations.  The  other  is  determined  by  the  relative  per- 
unit-block  release  rates  of  type  a and  type  c_  blocks. 

Suppose  that 

r = r,  = r (3,6) 

a b c 


holds  as  was  assumed  implicitly  by  Knuth  3j.  This  assumption  means  t ,at , at 
the  time  of  each  storage  release,  any  given  type  a block  is  as  likely  to  <e 
released  as  any  given  types  b block  or  type  £ block.  The  last  term  in  Eq.  13.5) 
is  wiped  out,  leaving 


P 


1,  . ? - Pf> 

2 V1  N/1  2Nr 

c 


(3.7) 


where  we  have  introduced  the  relation  A = A(1  - p,).  Since  we  have  assumed 

6 t 

Eq.  (3.6),  the  overall  balance  equation  A = Ra  + R^  + Rc  reduces  to 

A = r (N  + N.  + N ) 
c a b c 

= Nr 

c 
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Eq.  3.7  then  becomes 


P 


1 / 

2 \Pf 


* 

= P 


(3.8) 


where  o*  is  Eq.(l.l),  Knuth's  estimate  of  o.  For  both  systematic  and  random 
placement,  it  is  unlikely  Chat  s'  varies  much  from  e 1 (see  Eq.  3.2)  so  that 


D =3  0 


(3.9) 


provided  N » 1.  In  the  systematic  placement  runs  plotted  in  Figs.  1-2,  the 
values  of  N for  r = 256,  512,  1024,  and  2048  were  N = 106.80,  52.57,  25.89,  and 
12.98,  respectively. 

Now  consider  the  validity  of  Eq.(3.6).  Suppose  that  the  dynamics  of  storage 

allocation  and  release  result  in  type  a blocks  being  fewer  and  relatively  older 

than  type  b or  c blocks.  Type  a blocks  would  then  be  relatively  likely,  per- 

unit-block,  to  be  released  at  any  given  time.  In  this  case,  Eq . (3.6) would  br 

violated  by  r > r , and  the  last  term  in  Eq . (3 . 5)would  produce  a decrease  in 
a c. 

the  ratio  p.  Indeed,  in  the  simulations  discussed  in  Section  2,  the  combination 
of  systematic  placement  with  uniformly  distributed  residence  times  has  the  fore- 
going effect.  In  order  to  see  why,  one  must  realize  first  that  systematic 
placement  results,  on  the  average,  in  each  block  within  a contiguous  group  of 
allocated  blocks  being  older  than  the  block  immediately  below  it,  and  the  bottom 
block  of  such  a group  being  younger  than  the  top  block  of  the  group  below. 


II 


Consider  a group  of  allocated  blocks  such  as  shown  in  Fig.  4.  Suppose 


? 
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that  the  top  block  b^  was  allocated  at  time  t^  and  the  next  block  was  allocated 

at  time  t^.  It  is  possible  for  b^  to  be  younger  than  c^  (t^  > t^),  but  this  would 

only  be  true  if  b^  resulted  from  an  exactly  fitting  allocation,  which  is  quite 

unlikely.  More  likely,  but  still  relatively  unlikely,  is  the  possibility  that  the 

two  blocks  were  allocated  simultaneously  in  a large  free  block  (t^  = t^).  Moat 

likely  is  the  case  of  c^  being  allocated  sometime  after  b^  after  sufficient  space 

had  accumulated  below  b^  (t^  < t ^) . The  foregoing  argument  applies  to  any  pair  of 

adjacent  blocks,  so  that  t^  < t^  < t^  < t^  holds  on  the  average.  Now,  if  residence 

times  are  uniformly  distributed  in  the  interval  [t  ,t,  ],  the  block  b,  will  be 

a b —1 

released  sometime  between  t,  + t and  t,  + t, . The  block  c„  will  be  released 

1 a 1 b -2 

sometime  between  t.  + t and  t„  + t . Since  t.  < t , the  block  b will  be  released 
z.  sl  z o L .L  I 

on  the  average  prior  to  c^ . Whenever 

(t2  ' fcl}  * (tb  * Ca}  <3-10> 

holds,  b^  will  always  be  released  prior  to  c^.  Similarly,  each  block  in  a 
contiguous  group  is  likely  to  be  released  prior  to  the  block  immediately  below 
it.  Since  it  is  unlikely  that  the  free  space  below  b^  resulted  from  the  release 
of  a block  allocated  after  Jb^,  the  top  block  in  the  group  beginning  below  the  free 
space  tends  to  be  older  than  b^  and  therefore  likely  to  be  released  prior  to  b^. 

If  it  is  released  prior  to  b, , then  sufficient  free  space  may  be  available  for  a 
new  allocation  against  the  bottom  of  b^.  This  tendency  for  young  blocks  to  join 
the  bottom  of  a contiguous  group  accompanies  the  tendency  for  the  oldest  block  to 
be  released  from  the  top  of  the  group.  Thus,  each  contiguous  group  of  blocks 
tends  to  migrate  downward  in  memory. 
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Whenever  Eq.  (3.10)  does  not  hold,  it  may  happen  that  is  released  before  b ^ , 
even  though  b^  is  older.  The  frequency  of  such  an  event  increases  with  the  magni- 
tude of  (t^  + t^)  - (t^  + t ) . If  the  resulting  type  a block  is  released  before 
any  allocation  is  made  underneath  it,  its  release  will  contribute  to  r^.  This  will 
happen  a significant  fraction  of  the  time  since  the  space  released  by  c ^ is  only  of 
average  size,  and  since  the  former  b^  is  likely  to  be  released  before  even  more 
space  is  made  available  by  the  release  of  c^.  Since  the  former  b^  is  close  to  the 
end  of  its  life,  it  is  relatively  likely  to  be  released  at  any  given  time;  thus, 
the  per-unit-block  release  rate  of  such  blocks  is  higher  than  or  c^.  The  result 
will  be  r^  > rc > provided  that  the  foregoing  mechanism  makes  the  principal  contri- 
bution to  Na.  It  is  not  difficult  to  see  that  systematic  allocation  makes  infrequent 
the  production  of  type  a blocks  by  other  mechanisms.  One  example  is  the  trans- 
formation of  b^  into  a type  a block.  Although  is  likely  to  be  released  before 
b^ , in  most  cases  additional  allocations  already  will  have  been  made  underneath  b^. 
Even  if  b^  does  become  of  type  a,  it  is  unlikely  to  remain  so  for  long. 

We  may  conclude  that  systematic  placement  indeed  results  in  > rc > which 
in  turn  produces  a significant  decrease  in  the  free-to-al located-block  ratio  p 
(Eq.  3.5).  It  should  be  obvious  that  the  mechanisms  that  strongly  favor  r^  > r^ 
for  systematic  placement  do  not  exist  for  random  placement.  Thus,  the  anomalous 
behavior  of  p in  Fig.  1 is  explained.  Since  p appears  to  be  slightly  less  than  p* 
in  the  random  placement  case,  the  data  suggest  that  r^  is  slightly  greater  than 
rc  for  random  placement  as  well,  albeit  much  less  so  than  for  systematic  placement. 
This  might  be  explained  by  noting  that,  since  no  newly  allocated  block  is  of  type  a, 
type  a blocks  tend  to  be  older  than  average  and  therefore  more  likely  to  be  released. 

It  is  important  to  realize  that  the  explanation  for  the  decreased  value  of  p 
in  the  case  of  systematic  placement  depended  on  more  than  the  concept  of  systematic 
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placement.  It  also  depended  on  the  release  process namely,  that  the  release 

time  for  each  block  was  determined  at  allocation  time  according  to  a uniform 
distribution  of  residence  times.  Thus,  the  longer  a block  was  in  memory,  the 
more  likely  it  was  to  be  released.  The  explanation  of  r&  > r^  depended  on  this 
correlation;  without  it,  the  explanation  would  be  invalid.  For  example,  suppose 
that  a given  block  is  released,  not  when  a prespecified  time  is  reached,  but  when 
the  block  is  selected  at  random  from  the  set  of  allocated  blocks.  In  this  case 
it  is  obvious  that  = rfa  = rc  holds  and  that  o will  be  given  by  Eq.  (3.8) 
whether  or  not  systematic  allocation  is  practiced. 

3.2  Additional  Simulation  Results 

In  Section  3.1,  based  on  simulation  data  (Section  2.2)  and  the  derivation 

of  Eq.  (3.5),  I developed  the  hypothesis  that  the  anomalous  behavior  results  from 

the  combined  effects  of  systematic  placement  and  the  statistics  of  the  release 

process.  This  development  included  an  explanation  for  r being  significantly  larger 

than  r in  the  case  of  systematic  placement.  Because  it  was  verbal,  qualitative, 
c 

and  filled  with  repeated  applications  of  such  weak  relations  as  "on  the  average 
more  likely  than,"  this  explanation  leaves  much  to  be  desired.  The  main  impediment 
to  better,  analytic  explanations  is  the  non-Markovian  nature  of  the  simulation 
dynamics.  Fortunately,  the  verbal  explanation  suggests  additional  simulation 
experiments  and  predicts  their  results.  Thus,  the  hypothesis  can  be  tested. 

For  any  two  adjacent  allocated  blocks,  if  t^  is  the  allocation  time  of  the 
upper  block  and  t ^ is  the  allocation  time  of  the  lower  block,  the  upper  block  will 
always  be  released  first  if  Eq.(3.10)  holds.  If  Eq.(3.10)  does  not  hold,  the  prob- 
ability that  the  upper  block  will  be  released  first  increases  as  the  quantity 

(t,  + t,  ) - (t„  + t ) decreases.  As  described  in  Section  3.1,  the  effect  producing 
lb  2 a 

r^  > rc  with  systematic  placement  depends  on  the  relatively  high  probability  of 
the  upper  block  being  released  first.  The  higher  this  probability,  the  more 
significant  will  be  the  third  term  in  Eq.  (3.5),  and  the  smaller  will  be  the  free- 
to-allocated-block  ratio  p.  The  foregoing  suggests  a series  of  experiments  in 
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which  p is  measured  as  the  range  of  memory  residence  times  (tL  - t ) is  varied. 

b a 

For  large  values  of  (t,  - t ),  the  effect  of  systematic  placement  on  r should 

d a a 

begin  to  disappear,  and  p should  approach  the  random  placement  and  p"  values. 

Fig.  5 shows  the  results  of  such  an  experiment.  The  mean  request  size 

for  all  runs  was  1024 . The  mean  request  residence  time  t = (t,  + t )/2  was  held 

b a 

constant  at  t = 100  while  the  width  of  the  uniform  distribution  ft  , t,  ] was  varied. 

1 a b 

The  distributions  used  were  90,110],  [75,125],  [50,150],  [25,175],  and  [0,200]. 

This  variation  is  plotted  on  the  abcissa  using  the  coefficient  of  variation 

(standard  deviation  divided  by  mean)  of  the  residence  time  distribution 

a = (t  - t )/(ty/12  ) = (t  - t )/346.41.  As  predicted,  the  free-to-aliocated- 
b a b a 

block  ratio  p for  systematic  placement  is  affected  strongly  by  a.  For  random 
placement,  p is  close  to  p"  in  all  cases.  The  significance  of  the  small  apparent 
slope  in  the  data  for  random  placement  is  uncertain.  Not  shown  in  Fig.  5 is  the 
result  of  an  additional  experiment  in  which  an  exponential  distribution  of  residence 
times  was  used.  The  coefficient  of  variation  for  the  exponential  distribution 
is  ck  «*  1.  The  mean  residence  time  was  t = 100  and  all  other  variables  were  the 
same  as  those  for  the  runs  shown  in  Fig.  5.  For  systematic  placement  the  average 
value  of  p was  p = .502.  For  random  placement  the  average  value  was  P = .497 
thus,  for  the  widespread  residence  times  produced  by  an  exponential  distribution, 
the  beneficial  effect  of  systematic  placement  disappears. 

As  in  the  simulations  discussed  in  Section  2.2,  systematic  placement 
resulted  in  higher  efficiency  E than  did  random  placement  (see  Fig.  6).  The 
data  for  each  point  in  Fig.  b were  taken  from  the  same  run  as  the  corresponding 
point  in  Fig.  5.  For  the  experiment  with  exponentially  distributed  residence 
times  (not  shown),  the  average  efficiency  for  systematic  placement  was  E = .757 
and  the  average  efficiency  for  random  placement  E = .755. 
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4.0 


DISCUSSION 


The  results  in  Section  3 show  that  the  anomalous  behavior  of  the  fifty- 
percent  rule  is  explained  well  by  the  hypothesized  combined  effects  of  systematic  placement 
and  the  statistics  of  the  release  process.  Given  systematic  placement,  which 
tends  to  order  blocks  within  groups  according  to  their  allocation  time,  the 
extent  of  the  anomaly  depends  on  the  extent  to  which  allocated  blocks  are  released 
in  the  order  of  their  allocation.  In  the  limit  of  perfect  first-in-first-out 
behavior,  there  would  never  be  more  than  two  free  blocks  and  allocated  blocks 
of  type  a would  never  be  produced.  For  non-Markovian  release  processes,  the 
extent  of  the  correlation  between  allocation  order  and  release  order  is  indicated 
by  the  coefficient  of  variation  a of  the  memory  residence  time  distribution.  For 
values  of  a less  than  about  a '•  .8,  the  free- to-al located-block  ratio  can  be  con- 
siderably less  than  1/2,  which  means  that  the  free  space  list  is  shorter  and  the 
performance  better  than  implied  by  the  fifty-percent  rule.  For  larger  values  of  a 
Knuth’s  estimate  o’  appears  to  be  accurate  provided  that  the  average  number  of 
allocated  blocks  is  high  (see  Eq.  (3.9)1. 

The  results  have  implications  for  situations  involving  "priority  interrupts" 
that  require  the  immediate  release  of  space.  Meeting  such  a requirement  by  ran- 
domly selecting  blocks  for  release  would  tend  to  equalize  r^.r^.  and  r , and 
would  therefore  be  bad.  Better  would  be  a policy  that  restricts  the  selection 
to  type  a blocks  or,  ‘if  there  happen  to  be  none,  to  type  b blocks  at  the  upper 
end  of  groups. 

Memory  compaction,  a process  that  rearranges  memory  contents  so  that  all 
free  space  is  contiguous,  is  an  expensive,  brute  force  way  of  making  the  best  use 
of  available  space.  The  results  of  Section  3 suggest  that  a modified  compaction 
algorithm,  in  which  type  a blocks  are  moved  down  until  they  become  type  b,  may 
prove  to  be  advantageous  in  some  situations. 
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Above  all,  like  those  in  [7],  the  results  reinforced  my  opinion  that  the 


dynamics  of  memory  usage  comprise  complicated  phenomena  in  which  observable 


effects  often  have  subtle  causes.  These  phenomena,  which  are  usually  intuitive 


only  after  the  fact,  are  best  studied  by  the  method  of  strong  inference  [15] 
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Note:  In  all  of  the  figures  showing  simulation  results,  the  memory  size  was 
32K,  first-fit  allocation  was  used,  request  sizes  were  exponentially  distributed, 
and  residence  times  were  uniformly  distributed.  Points  for  systematic  place- 
ment are  plotted  as  •.  Points  for  random  placement  are  plotted  as  X.  Points 
showing  the  estimate  p*  are  plotted  as  *.  Each  point  is  the  result  of  averaging 
ten  iterations.  The  error  bars  show  the  95%  confidence  limits  of  the  estimates 
of  the  means. 


— Free-to-allocated-block  ratio  p versus  mean  request  size  r.  Memory 
residence  times  were  uniformly  distributed  in  the  interval  ( 5,1 5] . 
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Fig.  3 — Diagram  showing  the  three  types  of  allocated  blocks  discussed  in  the  text. 
Memory  length  is  depicted  by  the  vertical  dimension  of  the  diagram.  The  arrow 
points  in  the  direction  of  increasing  address.  Cross-hatched  areas  represent  allocated 
blocks  and  empty  areas  represent  free  blocks.  In  the  simulations,  systematic  place- 
ment corresponds  to  allocating  a new  request  against  the  upper  end  of  a free  block  in 
this  diagram. 
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Fig.  6 — Allocation  efficiency  E versus  coefficient  of  variation  a of  the  memory 
residence  time  distribution.  The  data  for  each  point  wi  re  taken  from  the  same 
run  as  the  corresponding  point  in  Fig.  5. 
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